A radiomics-based model for the outcome prediction in COVID-19 positive patients through deep learning with both longitudinal chest x-ray and chest computed tomography images

The coronavirus disease 2019 (COVID-19) pandemic had a major impact on global health and was associated with millions of deaths worldwide. During the pandemic, imaging characteristics of chest X-ray (CXR) and chest computed tomography (CT) played an important role in the screening, diagnosis and monitoring the disease progression. Various studies suggested that quantitative image analysis methods including artificial intelligence and radiomics can greatly boost the value of imaging in the management of COVID-19. However, few studies have explored the use of longitudinal multi-modal medical images with varying visit intervals for outcome prediction in COVID-19 patients. This study aims to explore the potential of longitudinal multimodal radiomics in predicting the outcome of COVID-19 patients by integrating both CXR and CT images with variable visit intervals through deep learning. 2274 patients who underwent CXR and/or CT scans during disease progression were selected for this study. Of these, 946 patients were treated at the University of Pennsylvania Health System (UPHS) and the remaining 1328 patients were acquired at Stony Brook University (SBU) and curated by the Medical Imaging and Data Resource Center (MIDRC). 532 radiomic features were extracted with the Cancer Imaging Phenomics Toolkit (CaPTk) from the lung regions in CXR and CT images at all visits. We employed two commonly used deep learning algorithms to analyze the longitudinal multimodal features, and evaluated the prediction results based on the area under the receiver operating characteristic curve (AUC). Our models achieved testing AUC scores of 0.816 and 0.836, respectively, for the prediction of mortality. © 2023 SPIE.

Research on the classification of CT images of COVID-19 by pre-training model based on self-attention mechanism

Nowadays, with the outbreak of COVID-19, the prevention and treatment of COVID-19 has gradually become the focus of social disease prevention, and most patients are also more concerned about the symptoms. COVID-19 has symptoms similar to the common cold, and it cannot be diagnosed based on the symptoms shown by the patient, so it is necessary to observe medical images of the lungs to finally determine whether they are COVID-19 positive. As the number of patients with symptoms similar to pneumonia increases, more and more medical images of the lungs need to be generated. At the same time, the number of physicians at this stage is far from meeting the needs of patients, resulting in patients unable to detect and understand their own conditions in time. In this regard, we have performed image augmentation, data cleaning, and designed a deep learning classification network based on the data set of COVID-19 lung medical images. accurate classification judgment. The network can achieve 95.76% classification accuracy for this task through a new fine-tuning method and hyperparameter tuning we designed, which has higher accuracy and less training time than the classic convolutional neural network model. © 2023 SPIE.

Mixup-Inf-Net: A data augmentation algorithm for segmentation of new coronary pneumonia infections

In 2020, the global spread of Coronavirus Disease 2019 exposed entire world to a severe health crisis. This has limited fast and accurate screening of suspected cases due to equipment shortages and and harsh testing environments. The current diagnosis of suspected cases has benefited greatly from the use of radiographic brain imaging, also including X-ray and scintigraphy, as a crucial addition to screening tests for new coronary pneumonia disease. However, it is impractical to gather enormous volumes of data quickly, which makes it difficult for depth models to be trained. To solve these problems, we obtained a new dataset by data augmentation Mixup method for the used chest CT slices. It uses lung infection segmentation (Inf-Net [1]) in a deep network and adds a learning framework with semi-supervised to form a Mixup-Inf-Net semi-supervised learning framework model to identify COVID-19 infection area from chest CT slices. The system depends primarily on unlabeled data and merely a minimal amount of annotated data is required;therefore, the unlabeled data generated by Mixup provides good assistance. Our framework can be used to improve improve learning and performance. The SemiSeg dataset and the actual 3D CT images that we produced are used in a variety of tests, and the analysis shows that Mixup-Inf-Net semi-supervised outperforms most SOTA segmentation models learning framework model in this study, which also enhances segmentation performance. © 2023 SPIE.

A Comprehensive Review of Sound-Based Modalities for Automatic COVID-19 Detection using Deep Learning-Based Techniques

The World Health Organization has labeled the novel coronavirus illness (COVID-19) a pandemic since March 2020. It's a new viral infection with a respiratory tropism that could lead to atypical pneumonia. Thus, according to experts, early detection of the positive cases with people infected by the COVID-19 virus is highly needed. In this manner, patients will be segregated from other individuals, and the infection will not spread. As a result, developing early detection and diagnosis procedures to enable a speedy treatment process and stop the transmission of the virus has become a focus of research. Alternative early-screening approaches have become necessary due to the time-consuming nature of the current testing methodology such as Reverse transcription polymerase chain reaction (RT-PCR) test. The methods for detecting COVID-19 using deep learning (DL) algorithms using sound modality, which have become an active research area in recent years, have been thoroughly reviewed in this work. Although the majority of the newly proposed methods are based on medical images (i.e. X-ray and CT scans), we show in this comprehensive survey that the sound modality can be a good alternative to these methods, providing faster and easiest way to create a database with a high performance. We also present the most popular sound databases proposed for COVID-19 detection. © 2022 IEEE.

COVID-19 Image Segmentation Algorithms Based on Conditional Generative Adversarial Network

The size and location of the lesions in CT images of novel corona virus pneumonia (COVID-19) change all the time, and the lesion areas have low contrast and blurred boundaries, resulting in difficult segmentation. To solve this problem, a COVID-19 image segmentation algorithm based on conditional generative adversarial network (CGAN) is proposed. Uses the improved DeeplabV3+ network as a generator, which enhances the extraction of multi-scale contextual features, reduces the number of network parameters and improves the training speed. A Markov discriminator with 6 fully convolutional layers is proposed instead of a common discriminator, with the aim of focusing more on the local features of the CT image. By continuously adversarial training between the generator and the discriminator, the network weights are optimised so that the final segmented image generated by the generator is infinitely close to the ground truth. On the COVID-19 CT public dataset, the area under the curve of ROC, F1-Score and dice similarity coefficient achieved 96.64%, 84.15% and 86.14% respectively. The experimental results show that the proposed algorithm is accurate and robust, and it has the possibility of becoming a safe, inexpensive, and time-saving medical assistant tool in clinical diagnosis, which provides a reference for computer-aided diagnosis. © 2022 ACM.

Detecting Coronavirus (COVID -19) Disease Cues from Chest Radiography Images

This paper proposes a deep learning-based approach to detect COVID-19 infections in lung tissues from chest Computed Tomography (CT) images. A two-stage classification model is designed to identify the infection from CT scans of COVID-19 and Community Acquired Pneumonia (CAP) patients. The proposed neural model named, Residual C-NiN uses a modified convolutional neural network (CNN) with residual connections and a Network-in-Network (NiN) architecture for COVID-19 and CAP detection. The model is trained with the Signal Processing Grand Challenge (SPGC) 2021 COVID dataset. The proposed neural model achieves a slice-level classification accuracy of 93.54% on chest CT images and patient-level classification accuracy of 86.59% with class-wise sensitivity of 92.72%, 55.55%, and 95.83% for COVID-19, CAP, and Normal classes, respectively. Experimental results show the benefit of adding NiN and residual connections in the proposed neural architecture. Experiments conducted on the dataset show significant improvement over the existing state-of-the-art methods reported in the literature. © 2022 ACM.

Semi-Supervised Modified-UNet for Lung Infection Image Segmentation

Automatic lung infection segmentation in computed tomography (CT) scans can offer great assistance in radiological diagnosis by improving accuracy and reducing time required for diagnosis. The biggest challenges for deep learning (DL) models in segmenting infection region are the high variances in infection characteristics, fuzzy boundaries between infected and normal tissues, and the troubles in getting large number of annotated data for training. To resolve such issues, we propose a Modified U-Net (Mod-UNet) model with minor architectural changes and significant modifications in the training process of vanilla 2D UNet. As part of these modifications, we updated the loss function, optimization function, and regularization methods, added a learning rate scheduler and applied advanced data augmentation techniques. Segmentation results on two Covid-19 Lung CT segmentation datasets show that the performance of Mod-UNet is considerably better than the baseline U-Net. Furthermore, to mitigate the issue of lack of annotated data, the Mod-UNet is used in a semi-supervised framework (Semi-Mod-UNet) which works on a random sampling approach to progressively enlarge the training dataset from a large pool of unannotated CT slices. Exhaustive experiments on the two Covid-19 CT segmentation datasets and on a real lung CT volume show that the Mod-UNet and Semi-Mod-UNet significantly outperform other state-of-theart approaches in automated lung infection segmentation. IEEE

Improved method for COVID-19 Classification of Complex-Architecture CNN from Chest CT volumes using Orthogonal Ensemble Networks

This paper introduces the improved method for the COVID-19 classification based on computed tomography (CT) volumes using a combination of a complex-architecture convolutional neural network (CNN) and orthogonal ensemble networks (OEN). The novel coronavirus disease reported in 2019 (COVID-19) is still spreading worldwide. Early and accurate diagnosis of COVID-19 is required in such a situation, and the CT scan is an essential examination. Various computer-aided diagnosis (CAD) methods have been developed to assist and accelerate doctors' diagnoses. Although one of the effective methods is ensemble learning, existing methods combine some major models which do not specialize in COVID-19. In this study, we attempted to improve the performance of a CNN for the COVID-19 classification based on chest CT volumes. The CNN model specializes in feature extraction from anisotropic chest CT volumes. We adopt the OEN, an ensemble learning method considering inter-model diversity, to boost its feature extraction ability. For the experiment, We used chest CT volumes of 1283 cases acquired in multiple medical institutions in Japan. The classification result on 257 test cases indicated that the combination could improve the classification performance. © 2023 SPIE.

Integrating deep learning algorithms for the lung segmentation and body-part-specific anatomical classification with Medical Imaging and Data Resource Center (MIDRC)

Medical Imaging and Data Resource Center (MIDRC) has been built to support AI-based research in response to the COVID-19 pandemic. One of the main goals of MIDRC is to make data collected in the repository ready for AI analysis. Due to data heterogeneity, there is a need to standardize data and make data-mining easier. Our study aims to stratify imaging data according to underlying anatomy using open-source image processing tools. The experiments were performed using Google Colaboratory on computed tomography (CT) imaging data available from the MIDRC. We adopted the existing open-source tools to process CT series (N=389) to define the image sub-volumes according to body part classification, and additionally identified series slices containing specific anatomic landmarks. Cases with automatically identified chest regions (N=369) were then processed to automatically segment the lungs. In order to assess the accuracy of segmentation, we performed outlier analysis using 3D shape radiomics features extracted from the left and right lungs. Standardized DICOM objects were created to store the resulting segmentations, regions, landmarks and radiomics features. We demonstrated that the MIDRC chest CT collections can be enriched using open-source analysis tools and that data available in MIDRC can be further used to evaluate the robustness of publicly available tools. © 2023 SPIE.

COVID-19 Detection by Using Handcrafted Features Extracted From Chest CT-Scan Images

Coronavirus illness, which was initially diagnosed in 2019 but has propagated rapidly across the globe, has led to increased fatalities. According to professional physicians who examined chest CT scans, COVID-19 behaves differently than various viral cases of pneumonia. Even though the illness only recently emerged, a number of research investigations have been performed wherein the progression of the disease impacts mostly on the lungs are identified using thoracic CT scans. In this work, automated identification of COVID-19 is used by using machine learning classifier trained on more than 1000+ lung CT Scan images. As a result, immediate diagnosis of COVID-19, which is very much necessary in the opinion of healthcare specialists, is feasible. To improve detection accuracy, the feature extraction method are applied on regions of interests. Feature extraction approaches, including Discrete Wavelet Transform (DWT), Grey Level Cooccurrence Matrix (GLCM), Grey Level Run Length Matrix (GLRLM), and Grey-Level Size Zone Matrix (GLSZM) algorithms are used. Then the classification by using Support Vector Machines (SVM) is used. The classification accuracy is assessed by using precision, specificity, accuracy, sensitivity and F-score measures. Among all feature extraction methods, the GLCM approach has given the optimum classification accuracy of 95.6%. . © 2023 IEEE.

Assessing Robustness of a Deep Learning Model for COVID-19 Classification on Chest Radiographs

The COVID-19 pandemic has made a dramatic impact on human life, medical systems, and financial resources. Due to the disease's pervasive nature, many different and interdisciplinary fields of research pivoted to study the disease. For example, deep learning (DL) techniques were employed early to assess patient diagnosis and prognosis from chest radiographs (CXRs) and computed tomography (CT) scans. While the use of artificial intelligence (AI) in the medical sector has displayed promising results, DL may suffer from lack of reproducibility and generalizability. In this study, the robustness of a pre-trained DL model utilizing the DenseNet-121 architecture was evaluated by using a larger collection of CXRs from the same institution that provided the original model with its test and training datasets. The current test set contained a larger span of dates, incorporated different strains of the virus, and included different immunization statuses. Considering differences in these factors, model performance between the original and current test sets was evaluated using area under the receiver operating characteristic curve (ROC AUC) [95% CI]. Statistical comparisons were performed using the Delong, Kolmogorov-Smirnov, and Wilcoxon rank-sum tests. Uniform manifold approximation and projection (UMAP) was used to help visualize whether underlying causes were responsible for differences in performance between test sets. In the task of classifying between COVID-positive and COVID-negative patients, the DL model achieved an AUC of 0.67 [0.65, 0.70], compared with the original performance of 0.76 [0.73, 0.79]. The results of this study suggest that underlying biases or overfitting may hinder performance when generalizing the model. © 2023 SPIE.

Multi-Joint Unit Network for COVID-19 Diagnosis using X-Ray and CT Images

The global COVID-19 pandemic has caused a health crisis globally. Automated diagnostic methods can control the spread of the pandemic, as well as assists physicians to tackle high workload conditions through the quick treatment of affected patients. Owing to the scarcity of medical images and from different resources, the present image heterogeneity has raised challenges for achieving effective approaches to network training and effectively learning robust features. We propose a multi-joint unit network for the diagnosis of COVID-19 using the joint unit module, which leverages the receptive fields from multiple resolutions for learning rich representations. Existing approaches usually employ a large number of layers to learn the features, which consequently requires more computational power and increases the network complexity. To compensate, our joint unit module extracts low-, same-, and high-resolution feature maps simultaneously using different phases. Later, these learned feature maps are fused and utilized for classification layers. We observed that our model helps to learn sufficient information for classification without a performance loss and with faster convergence. We used three public benchmark datasets to demonstrate the performance of our network. Our proposed network consistently outperforms existing state-of-the-art approaches by demonstrating better accuracy, sensitivity, and specificity and F1-score across all datasets. © 2022 ACM.

Early detection of COVID-19 using deep learning architectures: CNN and resnet-101

The main purpose of this paper was to classify if subject has a COVID-19 or not base on CT scan. CNN and resNet-101 neural network architectures are used to identify the coronavirus. The experimental results showed that the two models CNN and resNet-101 can identify accurately the patients have COVID-19 from others with an excellent accuracy of 83.97 % and 90.05 % respectively. The results demonstrates the best ability of the used models in the current application domain. © 2022 IEEE.

X-rays imaging analysis for early diagnosis of the thoracic disorders using Capsule Neural Network with Transfer learning

Over the past few years, millions of people around the world have developed thoracic ailments. MRI, CT scan, reverse transcription, and other methods are among those used to detect thoracic disorders. These procedures demand medical knowledge and are exceedingly pricy and delicate. An alternate and more widely used method to diagnose diseases of the chest is X-ray imaging. The goal of this study was to increase detection precision in order to develop a computationally assisted diagnostic tool. Different diseases can be identified by combining radiological imaging with various artificial intelligence application approaches. In this study, transfer learning (TL) and capsule neural network techniques are used to propose a method for the automatic detection of various thoracic illnesses utilizing digitized chest X-ray pictures of suspected patients. Four public databases were combined to build a dataset for this purpose. Three pre trained convolutional neural networks (CNNs) were utilized in TL with augmentation as a preprocessing technique to train and evaluate the model. Pneumonia, COVID19, normal, and TB (Tb) were the four class classifiers used to train the network to categorize. © 2023 IEEE.

Classification of COVID-19 cases from chest CT volumes using hybrid model of 3D CNN and 3D MLP-Mixer

This paper proposes an automated classification method of COVID-19 chest CT volumes using improved 3D MLP-Mixer. Novel coronavirus disease 2019 (COVID-19) spreads over the world, causing a large number of infected patients and deaths. Sudden increase in the number of COVID-19 patients causes a manpower shortage in medical institutions. Computer-aided diagnosis (CAD) system provides quick and quantitative diagnosis results. CAD system for COVID-19 enables efficient diagnosis workflow and contributes to reduce such manpower shortage. In image-based diagnosis of viral pneumonia cases including COVID-19, both local and global image features are important because viral pneumonia cause many ground glass opacities and consolidations in large areas in the lung. This paper proposes an automated classification method of chest CT volumes for COVID-19 diagnosis assistance. MLP-Mixer is a recent method of image classification using Vision Transformer-like architecture. It performs classification using both local and global image features. To classify 3D CT volumes, we developed a hybrid classification model that consists of both a 3D convolutional neural network (CNN) and a 3D version of the MLP-Mixer. Classification accuracy of the proposed method was evaluated using a dataset that contains 1205 CT volumes and obtained 79.5% of classification accuracy. The accuracy was higher than that of conventional 3D CNN models consists of 3D CNN layers and simple MLP layers. © 2023 SPIE.

Comparative Study of VGG-13, AlexNet, MobileNet and Modified-DarkCovidNet for Chest X-Ray Classification

Convolutional neural network (CNN) is the most widely used structure-building technique for deep learning models. In order to classify chest x-ray pictures, this study examines a number of models, including VGG-13, AlexN ct, MobileNet, and Modified-DarkCovidNet, using both segmented image datasets and regular image datasets. Four types of chest X- images: normal chest image, Covid-19, pneumonia, and tuberculosis are used for classification. The experimental results demonstrate that the VGG offers the highest accuracy for segmented pictures and Modified Dark CovidN et performs best for multi class classification on segmented images. © 2023 Bharati Vidyapeeth, New Delhi.

Comparative Analysis of Linear Regression and Logistic Regression for the COVID-19 Detection from CT-Scans

The new emerging Coronavirus disease (COVID-19) is a pandemic disease due to its enormous infectious capability. Generally affecting the lungs, COVID-19 engenders fever, dry cough, and tiredness. However, some patients may not show symptoms. An imaging test, such as a chest X-ray or a chest CT scan, is therefore requested for reliable detection of this pneumonia type. Despite the decreasing trends both in the new and death reported cases, there is an extent need for quick, accurate, and inexpensive new methods for diagnosis. In this framework, we propose two machine learning (ML) algorithms: linear regression and logistic regression for effective COVID-19 detection in the abdominal Computed Tomography (CT) dataset. The ML methods proposed in this paper, effectively classify the data into COVID-19 and normal classes without recourse to image preprocessing or analysis. The effectiveness of these algorithms was shown through the use of the performance measures: accuracy, precision, recall, and F1-score. The best classification accuracy was obtained as 96% with logistic regression using the saga solver with no added penalty against 95.3% with linear regression. As for precision, recall, and F1-score the value of 0.89 was reached by logistic regression for all these metrics, as well as the value of 0.87 by linear regression. © 2022 IEEE.

Towards Lifting the Trade-off between Accuracy and Adversarial Robustness of Deep Neural Networks with Application on COVID 19 CT Image Classification and Medical Image Segmentation

Deep neural networks (DNNs) are vulnerable to adversarial noises. Adversarial training is a general strategy to improve DNN robustness. But training a DNN model with adversarial noises may result in a much lower accuracy on clean data, which is termed the trade-off between accuracy and adversarial robustness. Towards lifting this trade-off, we propose an adversarial training method that generates optimal adversarial training samples. We evaluate our methods on PathMNIST and COVID-19 CT image classification tasks, where the DNN model is ResNet-18, and Heart MRI and Prostate MRI image segmentation tasks, where the DNN model is nnUnet. All these four datasets are publicly available. The experiment results show that our method has the best robustness against adversarial noises and has the least accuracy degradation compared to the other defense methods. © 2023 SPIE.

COVID-19 Instance Segmentation Network Based on Semantic Information Generating Proposals

The CT images of lungs of COVID-19 patients have distinct pathological features, segmenting the lesion area accurately by the method of deep learning, which is of great significance for the diagnosis and treatment of COVID-19 patients. Instance segmentation has higher sensitivity and can output the Bounding Boxes of the lesion region, however, the traditional instance segmentation method is weak in the segmentation of small lesions, and there is still room for improvement in the segmentation accuracy. We propose a instance segmentation network which is called as Semantic R-CNN. Firstly, a semantic segmentation branch is added on the basis of Mask-RCNN, and utilizing the image processing tool Skimage in Python to label the connected domain for the result of semantic segmentation, extracting the rectangular boundaries of connected domain and using them as Proposals, which will replace the Regional Proposal Network in the instance segmentation. Secondly, the Atrous Spatial Pyramid Pooling is introduced into the Feature Pyramid Network, then improving the feature fusion method in FPN. Finally, the cascade method is introduced into the detection branch of the network to optimize the Proposals. Segmentation experiments were carried out on the pathological lesion segmentation data set of CC-CCII, the average accuracy of the semantic segmentation is 40.56mAP, and compared with the Mask-RCNN, it has improved by 9.98mAP. After fusing the results of semantic segmentation and instance segmentation, the Dice coefficient is 80.7%, the sensitivity is 85.8%, and compared with the Inf-Net, it has increased by 1.6% and 8.06% respectively. The proposed network has improved the segmentation accuracy and reduced the false-negatives. © 2022 ACM.

LLDSNet: Limited labeled data segmentation network for COVID-19 CT lesion segmentation

With the COVID-19 outbreak in 2019, the world is facing a major crisis and people's health is at serious risk. Accurate segmentation of lesions in CT images can help doctors understand disease infections, prescribe the right medicine and control patients' conditions. Fast and accurate diagnosis not only can make the limited medical resources get reasonable allocation, but also can control the spread of disease, and computer-aided diagnosis can achieve this purpose, so this paper proposes a deep learning segmentation network LLDSNet based on a small amount of data, which is divided into two modules: contextual feature-aware module (CFAM) and shape edge detection module (SEDM). Due to the different morphology of lesions in different CT, lesions with dispersion, small lesion area and background area imbalance, lesion area and normal area boundary blurred, etc. The problem of lesion segmentation in COVID-19 poses a major challenge. The CFAM can effectively extract the overall and local features, and the SEDM can accurately find the edges of the lesion area to segment the lesions in this area. The hybrid loss function is used to avoid the class imbalance problem and improve the overall network performance. It is demonstrated that LLDSNet dice achieves 0.696 for a small number of data sets, and the best performance compared to five currently popular segmentation networks. © 2023 SPIE.